• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The general field of the invention is that of display systems comprising several image projection devices (P) and a single screen (E). Said display system comprises a device for controlling the alignment of the different projected images so as to form a single image without apparent discontinuities. Each projected image comprises a detection pattern and the screen comprises a plurality of photosensitive sensors (C1, C2) arranged so that the detection patterns are formed on their photosensitive surfaces, the sensors being arranged to determine the position and / or the orientation of the detection patterns and their photometric characteristics.
    公开号:BE1020144A3
    申请号:E201100229
    申请日:2011-04-20
    公开日:2013-05-07
    发明作者:Loic Becouarn；Johanna Dominici；Siegfried Rouzes
    申请人:Thales Sa；
    IPC主号:
    专利说明:

    Monitoring system with multiple spotlights
    The field of the invention is that of projection visualizations whose continuous image is formed by several projectors.
    Large screens with a diagonal of more than one meter are now made from liquid crystal displays or plasma screens or projection systems. These screens are made to be viewed from far enough, that is to say at distances greater than or equal to 2 meters. The use of this type of screen to make an aircraft dashboard with a single continuous display area is not possible. Indeed, the user is at an average distance of about 70 centimeters from said board. If we want the pixel size to be less than or equal to the eye's resolution limit, that is, about V arc or 0.3 mrad, the size of a pixel must not exceed about 200pm. The corresponding resolution for a 1 meter wide screen is therefore at least 5000 pixels. This resolution currently does not exist for LCD or plasma screens, nor for the displays that make up the video projectors "LCD" (Liquid Crystal Display), "LCOS" (Liquid Crystal On Silicon) or "DLP®" "(Digital Light Processing), to name only the main technologies.
    To achieve this resolution in such important dimensions, the technical solution is to make a mosaic of projectors illuminating from the front or the rear a projection screen so that the user has the impression that the image is formed by a single projector. Thus, Figure 1 shows a perspective view of a dashboard having a single display screen E comprising five display areas ZA, each area being illuminated by a dedicated projector P, each projector having the appropriate resolution. FIG. 2 represents a front view of this projection screen E. The screen is represented in bold lines. Each display zone ZA represented in dotted lines is illuminated by an image lP resulting from a projector P of a size slightly larger than the display area so that the different images overlap as seen in FIG. 2. The different images lP are represented in fine lines.
    This technical solution, however, poses some problems that must be overcome. The first is the alignment between different P projectors that must be perfect. Indeed, if the images from the different projectors are not correctly aligned, the interface between the images is visible and gives the impression of seeing several screens. On the other hand, a continuous transition between two images is generally obtained by partially superimposing the adjacent images. If these images are not aligned, the information is scrambled and becomes unreadable in overlay areas. The second problem concerns uniformity of luminance. The luminance of all projectors must be consistent across the entire display area. A luminance different from one projector to another gives the impression of seeing several screens. These two problems can be adjusted during the manufacture of the screen and do not reappear during use "indoors", that is to say when the device is maintained at a room temperature and stable, between 15 ° C and 25 ° C, for example and in a vibration-free environment as proposed in US Pat. No. 7,334,901.
    But these problems can appear again when the conditions of use become extreme. Thus, in use on aircraft, the vibrations at takeoff and landing are very strong enough to disrupt the position of the projectors and thus the alignment of the projected images. In addition, the differences in temperature encountered are very important, the temperature can vary from -40 ° C to + 55 ° C, which may have a visible and different effect depending on the projectors, the colorimetry, the flow emitted by the sources of light and the direction of projection, causing a reappearance of the interfaces between the projected images.
    It is therefore important to know at all times the pointing direction of the projectors as well as their photometric and colorimetric properties. The technical problem to be solved is therefore to have in real time: a first means for correctly adjusting the alignment of the projectors;
    A second means for controlling the uniformity of luminance of all the projectors and the color balance.
    US 6,310,650 entitled "Method and apparatus for calibrating a tilt display" and US 6,804,406 entitled "Electronic calibration for seamless tilting display using optical function generator" describe a multi-projector display device whose control device comprises a camera on the side of the user that analyzes images from different projectors. In addition to the fact that the user may move between the camera and the screen and interrupt the measurement, this method requires the display of specific patterns. It is applicable during the manufacture and calibration of the screen at the factory, but does not allow to easily check in real time alignment.
    US Patent 6,362,797 entitled "Apparatus for Multiple Projection Projection Images in Cockpit Displays" describes a multi-projector display device whose control device comprises a camera disposed on the side of the projectors. The user can no longer interfere between the camera and the screen. The camera observes the composite image provided by the projectors and an algorithm deduces in real time the corrections to make. The effectiveness of this algorithm can be greatly degraded depending on the content of the displayed image. Image analysis algorithms also require very high computing power.
    All these solutions therefore have significant disadvantages. The device for controlling and adjusting the alignment and the photometric and colorimetric parameters of a multi-projector device according to the invention does not have these disadvantages. It essentially comprises simple shape positioning patterns generated at the edge of images and sets of linear sensors arranged at the edge of the screen. The adaptations are therefore minor compared to a display device without control device while allowing to respond to the problems posed by the misalignment of the projectors.
    More specifically, the subject of the invention is a display system comprising at least two image projection devices and a single screen, each projection device comprising a display and a projection optics arranged so as to project the image resulting from the display on a display area of the screen having a predetermined shape and location so that the different projected images from the different displays form a single image without apparent discontinuities, said display system comprising a control device and slaving the alignment of the different images with respect to the predetermined shapes and locations of the different display areas, characterized in that the image from each display comprises at least one detection pattern such as the projected image of said detection target is on the screen in a detection zone s of the image display area, the screen comprising a plurality of photosensitive sensors, each photosensitive sensor being associated with a projection device and arranged so that the projected image of a detection pattern from said device projection is formed on its photosensitive surface, the sensor being connected to electronic means arranged to determine the position and / or orientation of said detection pattern and its photometric characteristics.
    In a first embodiment, the photosensitive sensors are monochrome and the display emits triplets of successive images in time, a first image having a first pattern of a first color, a second image comprising a second pattern of a second color and a third image having a third pattern of a third color.
    In a second embodiment, the photosensitive sensors are trichromatic and the patterns are "white".
    Preferably, the photosensitive sensors comprise at least one bar of photosensitive detectors. More precisely, each sensor comprises two identical strips arranged in chevron. It is also possible to use matrix sensors.
    Advantageously, the detection patterns are zigzag or W-shaped patterns or bar-shaped patterns.
    Advantageously, in normal operating mode, the test patterns are transmitted at a given modulation frequency, the electronic means being arranged to detect said frequency, the absence of this frequency being characteristic of a fixed image.
    Advantageously, at least one first sensor is disposed in the center of a detection zone or at least one second sensor is disposed on the edge of two adjacent detection zones in a common area with two projected images so that at least the image projected a detection pattern of the first image and the projected image of a detection pattern of the second image can be formed on the photosensitive surface of said sensor.
    Preferably, the position and the orientation of the image coming from each projection device depend on the position and / or orientation information coming from the associated sensor and the luminance and the colorimetry of the image depend on the photometric data coming from said sensor associated.
    In a preferred application, the system is an aircraft dashboard.
    The invention will be better understood and other advantages will become apparent on reading the description which follows given by way of non-limiting example and by virtue of the appended figures among which:
    FIG. 1 represents a perspective view of a single-screen multi-projector display device;
    Figure 2 shows a front view of the screen and the different display areas;
    FIG. 3 represents a first exemplary embodiment of the detection pattern and its associated sensor;
    FIG. 4 represents a second example of implantation of the sensor and associated detection patterns.
    The display system according to the invention comprises a device for controlling and adjusting the alignment and the photometric and colorimetric parameters. This essentially comprises position and / or orientation detection systems associated with each image projection device. These systems are also known by the generic name of "DDP". It is thus possible to precisely determine the position and orientation of each image and, knowing this information, apply the appropriate position or orientation corrections.
    There are different types of "DDP". The detection system according to the invention comprises optical sensors arranged judiciously on the periphery of the screen. Each projected image comprises at least one detection pattern such that the projected image of said detection pattern is on the screen in a detection zone of an optical sensor and outside the image display zone. . Knowing the position and / or orientation of the detection pattern and its photometric characteristics, we deduce the corrections to make on the image.
    It is possible to use matrix sensors for detecting detection patterns. However, it is preferable to use sensors with photosensitive cell arrays that are well suited for this type of measurement. In this case, the patterns may have different possible shapes. In particular, it is possible to use rods in the form of barcodes inclined in a manner adapted to the orientation of the sensor.
    A detection method is particularly well suited to the device according to the invention. It consists of generating patterns in the form of networks of line segments, detecting quadruplets of points of intersection of said line segments with one or two photosensitive strips, identifying particular birapports existing between these four points, determining the orientation and position of the sight from these birapports. The detection patterns are generally zigzag or W-shaped patterns. It is shown that, in order to know both the orientation and position parameters, it is necessary for the sensor to comprise two non-collinear or chevron-shaped bars and the detection pattern has two patterns. The number of strips can be limited to one if the displacement of the image projector is constrained by a mechanical structure.
    Reference is made to the French patent application FR 2 920 546 from Thales entitled "Method for detecting the ends of a linear sensor in space by projection of patterns" for all technical information on this process. FIG. 3 represents the set of two inclined bars B arranged in the detection zone as well as the detection patterns Mw in the shape of W.
    The sensors must be able to give both photometric and colorimetric information on the image. In a first embodiment, the photosensitive sensors are monochrome and the display emits triplets of successive images in time, a first image comprising a first pattern of a first color, for example red, a second image comprising a second pattern of a second color, for example green and a third image having a third pattern of a third color, for example blue. It is then sufficient to synchronize the means for analyzing the data from the sensors with the emission of the colored patterns to find the desired colorimetric data.
    In a second embodiment, the photosensitive sensors are trichromatic and the patterns are "white". Primary color-sensitive bars, such as red, green and blue, are then mounted, allowing luminance uniformity and color balance to be enslaved by a direct measurement of the photometry and colorimetry of the projected patterns in time. real. These patterns must include the three primary colors and these patterns are called white.
    The sensors C are necessarily located at the edge of the screen as seen in FIG. 4. There are different possible implantations. We can implement the C1 sensor so that it is in the middle of an edge of the projected image that is dedicated to it. It is also possible to implant the sensor C2 in a detection zone common to two adjacent projected images. In this case, it is necessary to discriminate the patterns from the two images. There are different techniques available. It is possible to generate different pattern shapes, different color patterns, they can also be shifted in time so that the sensor receives at a given instant only one and only one pattern from a given projected image.
    The projection surface of the screen does not have to be flat. A curved surface whose shape is known can also serve as a screen.
    The set of sensors can be located on the periphery of the screen in a detection zone whose width does not exceed 20 mm.
    Knowing the position and / or orientation, photometry and / or colorimetry information from each sensor, it is easy to determine the position, orientation and photometric data of the image from each projection device and to make the necessary corrections if the image moves from its original position. It should also be noted that if the number of sensors is redundant, it becomes possible to check not only the position of the image but also the distortion of the screen.
    It is also possible to carry out an initialization phase in which the different sensor parameters are recorded when all the images are perfectly adjusted.
    O can very simply use the device according to the invention for the detection of frozen images. A critical error monitored in aircraft visualizations is the frozen image as it may go unnoticed by the crew for a period of time. Frozen image detection requires complex monitoring of the control signals of the LCD panels. In this case, there are sensors arranged in the transmitted image. In normal operating mode, it is therefore sufficient that the patterns are emitted at a given modulation frequency and that the electronic means are arranged to detect said frequency so that the absence of this frequency is characteristic of a fixed image.
    This control and control device has several significant advantages. It only requires a few minor changes to the screen and projection devices. These modifications consist in the introduction of photosensitive strips on the perimeter of the screen, in the introduction of patterns in the non visible parts of the projected images, in the creation of a loop of computation and servocontrol of the geometrical parameters and photometric images projected from the information from the sensors knowing that, by nature, the corrections to be made are necessarily small.
    The only limitation of this control device is that it preferable that the projected image includes a detection zone outside the display area so that one can have the sensors without shadowing on the screen, this may limit the display system to a device having two rows of projectors, each row may include an indeterminate number of projectors. This is largely sufficient to achieve an aircraft dashboard.
    权利要求:
    Claims (13)
    [1]
    A display system comprising at least two image projection devices (P) and a single screen (E), each projection device comprising a display and a projection optics arranged to project the resulting image (lP). the display on a display area (ZA) of the screen having a predetermined shape and location so that the different projected images from the different displays form a single image without apparent discontinuities, said display system comprising a device for controlling and controlling the alignment of the different images with respect to the predetermined shapes and locations of the different display areas, characterized in that the image issuing from each display comprises at least one detection pattern (Mw) such that the projected image of said detection pattern is on the screen in a detection zone located outside the display area. the screen comprising a plurality of photosensitive sensors (C1, C2), each photosensitive sensor being associated with a projection device and arranged in such a way that the projected image of a detection pattern derived from said projection device projection is formed on its photosensitive surface, the sensor being connected to electronic means arranged to determine the position and / or orientation of said detection pattern and its photometric characteristics.
    [2]
    2. Display system according to claim 1, characterized in that the photosensitive sensors are monochrome and in that the display emits triplets of successive images in time, a first image having a first pattern of a first color a second image having a second pattern of a second color and a third image having a third pattern of a third color.
    [3]
    3. Viewing system according to claim 1, characterized in that the photosensitive sensors are trichromatic and in that the patterns are "white".
    [4]
    4. Visualization system according to one of the preceding claims, characterized in that the photosensitive sensors comprise at least one bar (B) of photosensitive detectors.
    [5]
    5. Display system according to claim 4, characterized in that each sensor comprises two identical strips arranged chevron.
    [6]
    6. Visualization system according to one of claims 4 or 5, characterized in that the detection patterns are patterns zigzag or W.
    [7]
    7. Visualization system according to one of claims 4 or 5, characterized in that the detection patterns are patterns in the form of bar codes.
    [8]
    8. Viewing system according to one of claims 1 to 3, characterized in that the photosensitive sensors comprise at least one matrix of photosensitive detectors.
    [9]
    9. Viewing system according to one of the preceding claims, characterized in that in normal operating mode, the sights are emitted at a given modulation frequency, the electronic means being arranged to detect said frequency, the absence of this frequency being characteristic of a frozen image.
    [10]
    10. Viewing system according to one of the preceding claims, characterized in that at least one sensor is disposed in the center of a detection zone.
    [11]
    11. Viewing system according to one of the preceding claims, characterized in that at least one sensor is disposed at the edge of two adjacent detection zones in a common area with two projected images so that at least the projected image a detection pattern of the first image and the projected image of a detection pattern of the second image can be formed on the photosensitive surface of said sensor.
    [12]
    12. Display system according to one of the preceding claims, characterized in that the position and orientation of the image from each projection device depends on the position and / or orientation information from the associated sensor and the luminance and colorimetry of the image depend on the photometric data from said associated sensor.
    [13]
    13. Viewing system according to one of the preceding claims, characterized in that the system is an aircraft dashboard.
    类似技术:
    公开号 | 公开日 | 专利标题
    BE1020144A3|2013-05-07|SUPPORTED MULTI-PROJECTOR VISUALIZATION SYSTEM.
    EP2385405B9|2012-12-19|Panomaric projection device and method implemented by said device
    EP0875021B1|2006-03-01|Static screen for animated pictures
    FR2996929B1|2019-11-22|DEVICE AND METHOD FOR DISPLAYING IMAGES.
    EP3526965B1|2020-11-04|System for forming a floating image
    EP2530564A2|2012-12-05|Touch system with optical transmitters and receivers
    EP2382783A1|2011-11-02|Perimeter security system for the active analysis of images reflected by a mirror array onto a video camera
    EP2984443B1|2017-05-31|Three-dimensional image acquisition system
    FR2755516A1|1998-05-07|COMPACT ILLUMINATION DEVICE
    CA2640706A1|2007-08-23|Engine for video projection/digitiser/digital radar with multiple electromagnetic radiation beams
    EP1405138B1|2005-08-24|Back-projection screen
    FR2891062A1|2007-03-23|Optical device for e.g. advertising display, has lenticular network comprising elementary devices each with optical system presenting identical optical characteristics and symmetry axis of rotation perpendicular to focal plane of lens
    WO2005022256A2|2005-03-10|Image-recording and projection system using a screen which is shared by transparent and backscattering regions that are alternated over time
    FR3070073A1|2019-02-15|IMAGE PROJECTION APPARATUS
    WO2005034522A1|2005-04-14|Projection system having a secured optical engine comprising a supplementary image source
    FR2873457A1|2006-01-27|Still and moving picture projection system for e.g. video game, has lenticular network with elementary units having lenses, and deviators along which light rays from projector lens are deviated to project picture on even surface of screen
    FR2948172A3|2011-01-21|LUMINOUS WALL
    EP3884656A1|2021-09-29|Device and method for observing a scene comprising a target
    EP3350581A1|2018-07-25|Calibration or test pattern
    EP2887657A1|2015-06-24|Electro-optical crossfading
    FR2905473A1|2008-03-07|Stationary or moving image display device for e.g. three dimensional TV application, has lenticular network and interlaced image with dimensional variations that are based on temperature or hygrometry variations and identical in direction
    WO2004062294A2|2004-07-22|Image projection system comprising a single imager which is equipped with photosensitive sensors for the identification of illumination colours
    FR2858423A1|2005-02-04|Image restitution system, has control device to control display of images in zones of display environment when determination device determines that eye of observer is near border between zones
    FR2937748A1|2010-04-30|Secure projection device i.e. holographic video projector, for e.g. medicine field, has calculation units determining target image by using Fourier transform of output image, and error detection units comparing input image and target image
    FR2503389A1|1982-10-08|Virtual image display for TV or photographic projector - has image source mounted between concave spherical mirror and its focal point
    同族专利:
    公开号 | 公开日
    FR2959023A1|2011-10-21|
    FR2959023B1|2012-05-25|
    US20110255057A1|2011-10-20|
    CA2737823A1|2011-10-20|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US4234890A|1978-03-06|1980-11-18|Rca Corporation|Automatic setup system for television cameras|
    FR2584843B1|1985-07-12|1989-02-24|Sfena|EXTENDED FIELD VIEWING APPARATUS IN WHICH THE IMAGE IS FORMED BY THE JUXTAPOSITION OF AT LEAST TWO PARTIAL IMAGES|
    US4870268A|1986-04-02|1989-09-26|Hewlett-Packard Company|Color combiner and separator and implementations|
    FR2698994B1|1992-12-08|1995-01-06|Sextant Avionique|Device for controlling the position of an image in a head-up display device.|
    JPH08223356A|1994-12-13|1996-08-30|Fuji Xerox Co Ltd|Color linear image sensor and image processor|
    US6714689B1|1995-09-29|2004-03-30|Canon Kabushiki Kaisha|Image synthesizing method|
    US5980120A|1997-09-25|1999-11-09|Lucent Technologies Inc.|Fiber array test method and apparatus|
    US6310650B1|1998-09-23|2001-10-30|Honeywell International Inc.|Method and apparatus for calibrating a tiled display|
    US6362797B1|1999-05-14|2002-03-26|Rockwell Collins, Inc.|Apparatus for aligning multiple projected images in cockpit displays|
    US6553168B2|2000-05-23|2003-04-22|Honeywell International Inc.|Projection system utilizing fiber optic illumination|
    US6804406B1|2000-08-30|2004-10-12|Honeywell International Inc.|Electronic calibration for seamless tiled display using optical function generator|
    US6956503B2|2002-09-13|2005-10-18|Canon Kabushiki Kaisha|Image display apparatus, image display method, measurement apparatus, measurement method, information processing method, information processing apparatus, and identification method|
    US7181066B1|2002-12-26|2007-02-20|Cognex Technology And Investment Corporation|Method for locating bar codes and symbols in an image|
    US7001023B2|2003-08-06|2006-02-21|Mitsubishi Electric Research Laboratories, Inc.|Method and system for calibrating projectors to arbitrarily shaped surfaces with discrete optical sensors mounted at the surfaces|
    US7182465B2|2004-02-25|2007-02-27|The University Of North Carolina|Methods, systems, and computer program products for imperceptibly embedding structured light patterns in projected color images for display on planar and non-planar surfaces|
    TWI274513B|2004-07-23|2007-02-21|Seiko Epson Corp|Image display method, image display equipment, optical scattering means, and image display program|
    US7252387B2|2005-03-21|2007-08-07|Mitsubishi Electric Research Laboratories, Inc.|System and method for mechanically adjusting projector pose with six degrees of freedom for image alignment|
    US7334901B2|2005-04-22|2008-02-26|Ostendo Technologies, Inc.|Low profile, large screen display using a rear projection array system|
    NO330155B1|2006-02-28|2011-02-28|3D Perception As|Method and apparatus for use in calibrating a projector's image display to a display screen, and display screen for such use.|
    US20090273662A1|2006-03-15|2009-11-05|Zebra Imaging, Inc.|Systems and Methods for Calibrating a Hogel 3D Display|
    FR2905455B1|2006-09-05|2008-10-17|Thales Sa|METHOD FOR DETECTING THE ORIENTATION AND POSITION OF AN OBJECT IN THE SPACE|
    FR2920546B1|2007-08-31|2011-02-11|Thales Sa|METHOD OF DETECTING THE END OF A LINEAR SENSOR IN SPACE BY PROJECTING MIRES|
    US8325282B2|2008-04-08|2012-12-04|Mitsubishi Electric Visual Solutions America, Inc.|Television automatic geometry adjustment system|FR2998990B1|2012-11-30|2014-11-21|Thales Sa|VISUALIZATION DEVICE COMPRISING A VISUALIZATION SCREEN WITH CONTROLLED TRANSPARENCY|
    US9532016B2|2013-04-10|2016-12-27|Prysm, Inc.|Self aligning imager array|
    FR3004817B1|2013-04-19|2015-05-15|Thales Sa|HYBRID VISUALIZATION SYSTEM DISPLAYING SUPERPOSITION INFORMATION OUTSIDE|
    US9992486B2|2014-02-13|2018-06-05|Highlands Technologies Solutions|Method of enhanced alignment of two means of projection|
    JP6232363B2|2014-09-29|2017-11-15|矢崎総業株式会社|Vehicle display device|
    JP6769179B2|2016-08-31|2020-10-14|株式会社リコー|Image projection system, information processing device, image projection method and program|
    法律状态:
    优先权:
    申请号 | 申请日 | 专利标题
    FR1001666A|FR2959023B1|2010-04-20|2010-04-20|ASSEMBLY MULTI-PROJECTOR VISUALIZATION SYSTEM|
    FR1001666|2010-04-20|
    [返回顶部]